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and can serve as a basis for educational reform. It was designed to compile a 
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previously developed to determine educational researcher and administrator 
attitudes. Of the total of 3,141 surveys mailed, 1,818 were returned. Results 
show substantial agreement between researchers ' and administrators ' views on 
the relative influences of educational policies and practices. Such consensus 
assures that a knowledge base of successful programs can be used to help 
improve academic achievement. Results suggest that instruction, curriculum, 
and school -wide practices have considerably stronger learning influences than 
federal, state, and district policies. Many highly influential practices and 
few highly influential policies can serve as promising candidates for 
educational reform since both researcher and administrator groups concur 
about their efficacy. Especially promising are the policies agreed on as high 
influence and highly assessable. Item influence and assessability ratings 
might be useful in identifying delivery standards, local program development, 
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implementation, and identifying and designing outcomes for use in summative 
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Research and practitioner knowledge about what makes learning effective can help improve edu- 
cational policies and practices. New understandings about how children learn can contribute to such chal- 
lenges as upgrading the nation's teaching corps, setting opportunity standards, and generally enhancing the 
academic performance of the nation's children and youth. Such challenges underscore the need to bring 
what is known about learning to the national agenda of educational reform. 

A gap separates what is known about learning and what educators actually do. One reason for 
this gap is that knowledge about effective practices and policies is not accessible to field-based profession- 
als in useful and usable forms. This paper identifies research findings from a study on researcher and prac- 
titioner views of the relative effects of policies and practices on learning, and the degree to which the 
implementation of what they view as important policy and practice influences on learning can be assessed 
and can serve as a basis for educational reform. 

The Context of Educational Reform 

Standard setting has become the most visible activity in the current wave of educational reform. In 
fact, in his seminal handbook chapter on standards, Roth (1996) has described the past two decades as the 
"Era of Standards." Beginning with the National Council of Teachers of Mathematics' (1989) Curriculum 
and Evaluation Standards for School Mathematics , professional education organizations have developed 
content standards that influence curricula, instruction, and assessment practices in mathematics, science, 
language arts, history, and geography. The U.S. Department of Education regards standard setting as cen- 
tral to achieving the National Education Goals. For example, both the Goals 2000: Educate America Act 
and the new Title I legislation require that each state establish standards for student achievement and focus 
educational reform efforts around achieving them. Another example is the National Assessment of Educa- 
tional Progress (NAEP), which aligned its mathematics assessment to the NCTM standards (Gandal, 

1995). 

Over the life of the educational reform movement numerous types of standards have emerged. Roth 
(1996) cites Dicz (1994) who identified seven types of standards: content, student performance, delivery. 



opportunity, assessment, instructional, and standards for standards. Content standards identify the knowl- 
edge and skills that students must master, student performance standards identify the degree of competency 
that must be demonstrated for each content standard, and school delivery standards identify criteria indi- 
cating whether a school provides students with the "opportunity to learn" the material identified in the con- 
tent standards.- System delivery standards address the quality of the district, state, or federal systems' 
capability to educate all students as specified in the content standards. Systemic reform, presumably, coor- 
dinates these different types of standards in order to attain its goal of improved learning for all students 
(Smith, Fuhrman, & O'Day, 1994). 

Standard-based reform is clearly reflected in Title I of the 1994 reauthorization of the Elementary 
and Secondary Education Act of 1965 (ESEA), entitled the Improving America's School’s Act (IASA). 
Designed to provide at-risk children with the tools necessary to meet challenging academic standards, the 
Title I legislation emphasizes the alignment of various components of the educational system, including 
curriculum and instruction, professional development and accountability. Schools that receive Title I funds 
must demonstrate the inclusion of challenging content and performance standards into their educational 
plan. These standards are aimed at broadening disadvantaged children's knowledge and skills bases. Cen- 
tral to the legislation's goal of bolstering children's academic performance is the improvement of teaching 
and learning. 

An unique feature of the Title I program in IASA is its schoolwide project provision. This provi- 
sion expands the Title I program to more efficiently meet the diverse needs of students who arc education- 
ally at risk by lowering the minimum poverty level necessary for a school to qualify for Title I funds. The 
goal is to integrate the programs and resources of each school by allowing its funding to be pooled with ad- 
ditional monies to make institutional and comprehensive change. Teaching and professional development 
are key components of the 1994 legislation's goal of creating more equitable learning opportunities for chil- 
dren who arc in circumstances that place them at risk of school failure. In keeping with the law's emphasis 



on equitable opportunities for all students, special provisions arc made to (a) giving primary consideration 
to extended-time strategies; (b) drawing from the research on effective teaching and learning techniques; (c) 
incorporating accelerated curricula and effective instructional strategies; (d) strong coordination with the 
regular program; and (e) use of highly qualified and trained staff*. In addition, Title I focuses on increased 
parental involvement, school-linked services and integration of the supplemental educational programs. It 
further stresses the need for local and inclusive planning and decision-making, thereby empowering mem- 
bers of the local school community to apply their finding to their individual needs. This increase in flexi- 
bility, coupled with a greater responsibility for improved student performance, creates the need for 
innovative and reliable strategies to achieve high-quality standard-based improvements at the district and 
school level. 

The present study, designed to compile a database on research findings, expert knowledge, and 
educators* judgments, aims to identity implementation standards for the delivery of standard-based re- 
forms. To implement such standards, educators must first identity the content and student performance 
standards they expect children to meet. Second, they must determine what teacher actions, instructional 
practices, student pursuits, and schoolwide policies should be implemented to guarantee that all students 
will have an opportunity to achieve the performance standards. It is expected that implementation of stu- 
dent performance and school delivery standards can result in increased effectiveness and efficiency. Fur- 
thermore, systemic documentation of such implementations should provide critical information about the 
design of programs to achieve such delivery and outcome standards. 

It is in this context of contributing to the procedural knowledge on standard-based program deliv- 
ery that the present survey study was developed. Research findings provide one foundation for developing 
opportunity to learn standards. Further guidance can be obtained through the expert judgments of both re- 
searchers and practitioners. Their knowledge about what influences students* learning can be compared to 
assess the correspondence of expert and practitioner views. Strong agreement in the judgments of these 
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groups would lend confidence to making their combined judgments of effectiveness a basis for selecting re- 
form strategies. 

The Study Design: A Conceptual Framework 

The conceptual framework for the present survey study on educational policies and practices that 
promote achievement was drawn from the extant research base identified in prior research syntheses. Some 
of these syntheses compared the relative effectiveness of multiple influences on learning, whereas others fo- 
cused on the effectiveness of specific instructional practices. 

Syntheses of Multiple Influences on Learning 

Walberg, Schiller, and Hacrtcl (1979) published one of the first quantitative syntheses of research 
on teaching. The authors collected reviews published between 1969 and 1979 on the impact or association 
of instructional variables on students* cognition, affect, and behavior. Among the instructional practices 
synthesized were: time on task, mastery learning, psychological incentives, open versus traditional class- 
rooms, and advance organizers. Nearly two- thirds of the effect sizes or correlations synthesized were 
positive, indicating that many well-established educational practices promote student achievement. In ad- 
dition, in a systematic examination of 19 reviews of teaching process-student outcome research, Waxman 
and Walberg (1982) identified instructional processes related to student learning. They identified the fol- 
lowing practices as positively associated with student learning: cognitive engagement, motivational incen- 
tives, pupil involvement in learning, reinforcement, and classroom management and climate. 

In 1987 a special issue of the International Journal of Educational Research was dedicated to an 
extensive review of research by Fraser and colleagues on influences related to school learning. They sum- 
marized results of over 2,000 bivariate studies spanning 50 years of research in the United States and 
abroad. In this special issue, Fraser ct al. (1987) presented a meta-review of 135 meta-analyses in which 
school achievement was an outcome, and 92 meta-analyses with student attitude as an outcome. Among 
the influences examined were contextual factors, including student and teacher characteristics, curriculum 
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materials, facilities and equipment, home environment, and school climate. Aptitudinal, instructional, and 
environmental factors that consistently exhibited strong influences on academic achievement were identi- 
fied. 

Wang, Haertcl, and Walbcrg (1993) synthesized ratings of 61 research experts, 91 meta-analyses, 
and 179 handbook chapters and narrative reviews representing approximately l 1,000 statistical relation- 
ships. Results confirmed the primacy of student characteristics, instruction, and home and community in- 
fluences on academic learning. More distal variables, such as state and district policy, were shown to be 
less influential. 

The dramatic pattern of overall positive results reported in the research syntheses above is charac- 
teristic of results from quantitative syntheses and meta-analytic reviews. This pattern of results is not an 
artifact of meta-analysis nor can it be attributed to a generalized placebo effect (Lipsey & Wilson, 1993). 
Syntheses of Specific Instructional Practices that Influence Learning 

Since the mid-1970s many quantitative research syntheses have been conducted on specific in- 
structional practices. Among the specific instructional practices that have been found to consistently im- 
prove academic learning are: degree of curriculum articulation and organization; sufficient classroom 
materials to support the instructional program; maximized learning time; high student expectations; op- 
portunities for students to give extended oral and written responses; degree of classroom engagement; stu- 
dent participation in goal setting and instructional decision-making; opportunities for students to receive 
intensive instruction in one-on-one or tutoring arrangements; engagement in cooperative learning; frequent 
assessment; and a home environment that supports learning (Fraser et al., 1987; Lipsey & Wilson, 1993; 
Wangetal., 1993). 

Individual meta-analyses on which these syntheses arc based concern computer aided/based 
instruction (Kulik & Kulik, 1987; Ryan, 1991); programmed or individualized instruction (Bangcrt, Kulik, 
& Kulik, 1983); cooperative task structures (Johnson, Johnson, & Mamyama, 1983; Johnson, Maruyama, 
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Johnson, Nelson, & Skon, 1981); student tutoring (Cohen, Kulik, & Kulik, 1982; Cook, Scruggs, 
Mastropieri, & Casto, 1986); behavioral objectives, reinforcement, cues, and feedback (Lysakowski & 
Walberg, 1982); mastery learning (Guskcy & Pigott, 1988); home environment (Graue, Weinstein, & 
Walberg, 1983); technology-based instructional strategics (Shwalb, 1987; Williams, 1990); reading 
instruction strategies (Pflaum, Walberg, Karcgiancs, & Rasher, 1980); whole-language approach (Stahl & 
Miller, 1989); vocabulary instruction (Klcsius & Scarls, 1990; Stahl &. Fairbanks, 1986); and bilingual 
instruction (Willig, 1985). 

Summary 

These syntheses support the primacy of student characteristics, instructional practices, and home 
and community influences on student learning. Based on these results, a theoretical framework comprised 
of 228 influences on student learning and organized within six theoretical constructs: (a) State and District 
Governance and Organization; (b) Home and Community Educational Contexts; (c) School Demographics, 
Culture, Climate, Policies, and Practices; (d) Design and Delivery of Curriculum and Instruction; (e) 
Classroom Instructional Practices; and (f) Student Characteristics. This framework was updated and 
refined for purposes of this research (see Wang et al. [1993] for a detailed description of the previous 
framework and theoretical constructs). 

Method 

Item Selection 

The 146 survey items used in the present survey study were drawn from an earlier 228-item survey 
that was used to rate influences on learning (Reynolds, Wang, and Walberg, 1992). Those items that were 
selected focused on classroom practices, schoolvvide practices and policies, curriculum design and delivery, 
and district, state, and federal policies. Some of these items were revised and tailored for the purposes of 
this study. 
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Construction of Rating Scales 

Two Likert rating scales were constructed: degree of influence on learning and assessability. For 
purposes of this research, influence on learning is defined as the degree to which students acquisition of 
knowledge, skills, attitudes and values is affected by educational practices and policies. The three-point 
rating scale is presented below: 

1 = Little or no influence on learning 

2 = Moderate influence on learning 

3 = Strong influence on learning 

Assessability is defined as the extent to which the presence or absence of the policy or practice can 
be ascertained by direct observations, archived documents, or other means. The following rating scale was 
utilized to rate assessability: 

1 = Not assessable 

2 = Fairly assessable 

3 = Very assessable 

Background Information and [tern Assignment Into Categories 

Different background items were prepared for each of the two groups, educational researchers and 
administrators. Researchers were asked to identify their primary research interest (c.g., administration and 
curriculum studies) and gender; educational administrators were asked to identify their current position 
(e.g., principal or superintendent), gender, the type of school administered (c.g., elementary or middle 
school), and the location of schools or districts (c.g., urban or suburban). 

Three independent judges classified the 146 items into four categories: Classroom Practices (70 
items); School wide Practices and Polices (39 items); Curriculum Design and Delivery (16 items); and Fed- 
eral, State, and District Policies (21 items). To save respondents time and promote high return rates, the 



146 items on the survey were randomly divided into three forms, so that each recipient received a survey 
with no more than 50 items drawn from each of the four categories. 

Sample Selection 

Eight samples were drawn from die following six organizations: American Educational Research 
Association (AERA) Divisions A (Administration), C (Learning and Instruction), and H (Evaluation); Na- 
tional Association of Elementary School Principals (NAESP); and National Association of Secondary 
School Principals (NASSP); American Association of School Administrators (AASA); Council of the 
Great City Schools (CGCS); and Council of Chief State School Officers (CCSSO). Membership lists were 
used to draw random samples for each organization. In two of the organizations (CCSSO and CGCS) 
every member was sampled because of their small universes. In the other four organizations (AASA, 
NAESP, NASSP, and AERA) random samples without replacement were drawn. 

Mail surveys were sent to all recipients in November 1993; non-respondents were sent a follow-up 
survey in January 1994. Survey directions requested that participants rate each item in terms of its influ- 
ence on student learning and assessability. 

Results 

Survey Return Rates 

Table 1 presents the number of recipients and percent return for each professional group and for 
the total sample on the original and follow-up mailings. Before combining the original and follow-up sur- 
vey data, Chi-square analyses were calculated. For each of the three forms of the survey, chi squares were 
calculated to test differences among return rates by original and follow-up mailings for: males and females; 
membership in professional groups for researchers (AERA Divisions A, C, and H); and membership in 
professional groups for administrators (NAESP, NASSP, AASA, CGCS, and CCSSO). Of the 12 Chi- 
squares calculated only one was significant, male versus female researchers on Form I of the survey 
(x 2 =6.48, df=l, p<.0l). These results suggest that the 42% of the sample that never replied may not differ 
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much from the 58% that did, allowing for change in address, loss in the mail, and other reasons. Because 
there was only an isolated significant difference, and in light of the moderately high return rate for the sur- 
vey, the data from the original and follow-up mailings were combined. 



Insert Table 1 about here 



High Agreement between Researchers and Administrators on the Influence of Practices 

The three AERA Divisions (A, C, and H) were grouped together as "‘Researchers” and the AASA, 
CCSSO, CGCS, NAESP, and NASSP respondents were grouped as “Educational Administrators.” Aver- 
ages of the item ratings were calculated for the researcher and the administrator groups. The correlations 
presented in Table 2 show very high agreement between the researcher and administrator ratings of influ- 
ence (r=. 87, p< .01) and ratings of assessability (r=.68, p<.01). This suggests that the research community 
has been particularly adept in communicating the knowledge base on effective practices and policies to the 
school community, and that there is substantial consensus between the two groups on the relative influences 
of specific policies and practices and the degree to which they can be assessed. Since there is substantial 
agreement between researchers and administrators justifies a closer examination of their rankings of influ- 
ence across the four categories as well as the specific policies and practices within each area, as discussed 
in subsequent sections. 



Insert Table 2 about here 



Average Influence and Assessability Ratings bv Category 

Table 2 shows the average influence and assessability ratings for all respondents for each of the 
four categories for influence on learning and assessability. These averages show the strong influence of 
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proximal influences on the learner, namely classroom, schookvide, curricular, and delivery practices. By 
contrast, the respondents saw federal, state, and district policies as relatively weak. Ironically, however, 
the respondents saw the extramural policies as more assessable than the proximal influences. 



Insert Table 3 about here 



Differences Among Professional Groups 

Ten one-way analyses of variance (ANOVA) were conducted to determine whether there were dif- 
ferences in average influence and assessability ratings among the eight professional groups. As shown in 
Table 3, all ANOVAs were statistically significant (pc.OOOl) indicating variations in the degree of influ- 
ence perceived by the groups. As shown in Figure 1, the three researcher groups (AERA Divisions A, C, 
and H) rated practices and policies in each of the four categories, as less influential than did the five ad- 
ministrator groups (AASA, CCSSO, CGCS, NAESP and NASSP). 



Insert Table 4 and Figure 1 about here 



Four of the five ANOVAs for assessability were significant: Classroom Practices (p<.000 1); 
Schoolwidc Practices (pc.OOOl); Federal, State, and District Policies (p. < 0001); and total (p< 003). As 
shown in Figure 2, the researcher groups rated the Federal, State, and District Policies as more assessable 
than did the administrator groups. In general, elementary and secondary school principals rated Classroom 
Practices and School wide Practices as more assessable than did the other groups of administrators and re- 
searchers. 



10 



er|c 



13 



Insert Figure 2 about here 

Specific Influence Ratings 

Average influence ratings for each item within each of the four categories arc presented in Tables 
5-8. The highest quartilc is comprised of items with average ratings equal to or above 2.52; such items are 
indicated in the tables. 



Insert Tables 5-8 about here 



As shown in Table 5, the highest quartile of influence ratings contained 18 of the 70 Classroom 
Practice items. These items focus on the teacher in the central classroom role, a cognitively challenging en- 
vironment; and on the frequency and nature of teacher-student interactions about the learning activity. 

Table 6 shows that, of the 39 Schoolwide Practice items, 1 1 were in the highest quartile. These 
items include: a safe, orderly, positive, and academically-oriented school climate; parenUnvolvement pro- 
grams; guarding of student instructional time; collaboration and shared decision-making among staff and 
administrators; and low staff alienation and absenteeism. 

Table 7 shows that four of the 16 Curriculum Design and Delivery items were in the highest quar- 
tile. Curriculum-related practices were perceived as influential when they are sensitive to students' cognitive 
needs, but less influential when they are responsive to students' interests, preferences, and cultural back- 
grounds. Highly influential items focus on alignment of curriculum content, instruction, and assessment; 
tailoring the content to students' cognitive capabilities and prior knowledge; and availability of materials 
and activities for different instructional groupings. 
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As show in Table 8, of the 21 Federal, State, and District Policy items, only two were in the high- 
est quartile of influence: central office and board of education support. This finding indicates that the most 
influential policies are manifested in the form of local resources and assistance for school programs. 
Specific Assessabilitv Ratines 

Average assessability ratings for each item within each of the four categories arc also presented in 
Tables 5-8. The highest quartile of assessability is comprised of items with average ratings equal to or 
above 2.34. 

Classroom practice items (Table 5) ranked as most assessable concerned observable features of 
classroom environments and the presence or absence of particular practices. They include, for example, 
resources and instructional and grouping practices, such as size of instructional groups, well-organized les- 
sons, frequent and corrective feedback, explicit expectations of content mastery, computer-assisted instruc- 
tion, and frequent measurement of basic skills. Items related to judgments of teacher style, such as 
encouragement or discouragement, enthusiasm, or other personality features were rarely ranked in the high- 
est quartile. 

Only seven of the 39 Schoolwide Practice items were rated as highly assessable (Table 6). Assess- 
able items were those that were easy to judge — a safe, orderly school climate, school size, explicit school- 
wide policies, and low staff absenteeism and turnover. The remaining 32 items, which were judged as less 
assessable, were those that require evidence of consensus, positive attitudes, and other less observable 
practices among school staff and students (e.g., schoolwide activities to promote positive, nondisruptive 
behaviors; a positive attitude toward school, teacher, and subject matter; and promotion of student self- 
esteem and self-confidence). 

Eight of 16 Curriculum Design and Delivery items (Table 7) were highly assessable. They focused 
on tangible features of curriculum materials and the delivery of curriculum content within the classroom 
environment. The attributes of materials that were judged most assessable include the presence of specific 
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objectives, assessments, and activities tailored to different instructional groupings and students' cognitive 
and academic needs. The most assessable aspects of the delivery of curriculum content are features and 
practices that are directly observable, including the availability of sufficient materials, human resources, 
and procedures for effective behavioral and cognitive management. 

Of the 21 Federal, State, and District Policies, ten items were in the highest quartile of assessability 
(Table 8). Most of these items were judged highly assessable because the presence or absence of a federal, 
state, or district policy can generally be detected either through document review or minimal data collec- 
tion. Central office and board of education assistance and support for school programs, were judged as 
highly influential but not highly assessable. This may be because support for school programs consists of a 
large variety of forms, including provision and training of personnel, tangible resources (e g., materials, 
space), intangible resources (e.g., expertise, reinforcement, sponsorship), as well as fiscal assistance. This 
complexity reduces the ease of assessability. 

Joint Ratings of Influence and Assessability 

A fourfold table was created to further analyze the items within the highest and lowest quartiles in 
each of the four categories. Table 9 displays items in the following four cells: high influence-high assess- 
ability, high influence-low assessability, low influence-high assessability, and low influence-low assess- 
ability. 



Insert Table 9 about here 



The primary findings of this analysis arc that classroom practices, and to a somewhat lesser de- 
gree, schoolvvide practices and curriculum design and delivery, have high influence on student learning and 
arc readily assessable. Federal, state, and district policies were judged to have little influence on student 
learning, although they are also readily assessable. 



Although researchers and administrators can agree on whether specific practices and policies are 
influential and vvhcdier they are assessable, these groups differ in their judgment of the relationship between 
the influence and assessability of specific practices and policies. The correlation between influence and as- 
sessability ratings for researchers is near zero (r=-.03, p> 10) whereas administrators judgments were mod- 
erately correlated (r=.52, p< .01). A possible reason for this difference is that researchers arc less 
optimistic about the assessability of many practices and policies. 

Conclusions 

The results show substantial agreement between researchers’ and administrators' views on the 
relative influences of educational policies and practices. Such consensus gives a measure of assurance that 
a knowledge base on what works might be exploited to assist in the national goal, expressed by many 
groups, for substantially improving academic achievement. 

The results suggest that instruction, curriculum, and school-wide practices have considerably 
stronger learning influences than do federal, state, and district policies. This seems an irony since much 
educational reform has been imposed by state legislatures and has concerned such governance and 
organization innovations as charter schools, public school choice, and school-site management. Though the 
average influence ratings differ across the four categories— classroom practices, school practices, 
curriculum design and delivery, and extramural policies, specific practices and policies vary considerably 
within these groups as shown in the detailed tables (Tables 5-9). Many highly influential practices and few 
highly influential policies can serve as promising candidates for educational reform since both research and 
administrator groups concur about their efficacy. 

Especially promising arc highly influcntial-highly assessable practices since they arc not only 
effective but observable. Those that arc effective but less assessable deserve high priority for systematic 
development and validation of observation, rating, and other means of assessment by research workers. 

While the eight groups of researchers and administrators agree on the relative size of the influences, 
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researchers are less sanguine about the size of the effects. Administrators may be somewhat more 
optimistic than researchers because they must often advocate innovations and because it is often their job to 
employ observation and rating scales to evaluate teachers and programs. 

To our knowledge, the present survey is the first of its kind. It represents in compact form a 
considerable amount of expert knowledge and administrator judgment about what works to improve 
achievement. Along with previous efforts to synthesize research, it may serve as one basis for planning 
education reforms. 

Specifically, the survey results can guide site-specific efforts to reform classroom and 
school practices and district, and state policies. The knowledge base on effective practices and policies, 
such as those found in the present survey study, is an existing resource that has significant implications for 
improving current practices to meet the legislative mandates, such as the Title I program, to significantly 
improve the learning of all students, including and particularly those requiring greater-than-usual support 
such as those served by Title I. Item influence and assessability ratings might be found useful in identify- 
ing delivery standards, local program development, the development of accountability measures, monitoring 
program implementation, and identifying and designing outcomes and indicators for use in summative 
evaluations. Though it can be hoped that the items might be widely useful for such purposes, educators 
would have to determine which survey items are most useful given their circumstances. In addition to con- 
sidering the influence and assessability ratings, they would need to judge which of the practices and policies 
are most suitable the economic, philosophical, political, and cultural climate of their communities. 
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Table 1 



Number of Survey Recipients and Original 
and Follow-up Survey Return Rates 





Survey Mailings 




Returns (%) 




Professional Group 


N 


Original 


Follow-Up 


Total 


AERA-Division A 


498 


235 (78.1) 


66(21.9) 


301 (60.4) 


AERA-Division C 


500 


237 (79.0) 


63 (21.0) 


300 (60.0) 


AERA-Division H 


499 


245 (80.3) 


60(19.7) 


305 (61.1) 


AASA 


546 


227 (73.9) 


80(26.1) 


307 (56.2) 


CCSSO 


57* 


22 (56.4) 


17(43.6) 


39 (68.4) 


CGCS 


43 


21 (77.8) 


6 (22.2) 


27 (62.8) 


NAESP 


500 


201 (67.9) 


95 (32.1) 


296 (59.2) 


NASSP 


498 


178 (73.3) 


65 (26.7) 


243 (48.8) 


Total 


3141 


1366 (75.1) 


452 (24.9) 


1818(57.9) 


*The CCSSO mailing was sent to state superintendents from the 50 states and Washington, D.C., the executive director 
of CCSSO, and the Superintendents of American Samoa, Puerto Rico, the Virgin Islands, and Manila/Philippines. 
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Table 2 



Pearson Product Moment Correlations for Researcher 
and Administrator Ratings of Influence and Assessability Ratings 





Researcher 


Researcher 


Administrator 


Administrator 




Influence 


Assessability 


Influence 


Assessability 


Researcher 

Influence 


1.00 








Researcher 

Assessability 


-.03 


1.00 






Administrator 

Influence 


.87 


-.10 


1.00 




Administrator 

Assessability 


.47 


.68 


.52 


1.00 
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Table 3 



Overall Average Influence and Assessability by Category 



Category 


Average Influence 


Average Assessability 


Classroom Practices 


2.39 


2.16 


Schoolwide Practices 


2.36 


2.15 


Design and Delivery of Curriculum 


2.33 


2.25 


Federal, State, and District Policies 


2.10 


2.35 
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Table 4 



One-Way Analyses of Variance Comparing Influence and 
Assessability Ratings of Professional Groups for Each Category 



Dependent Variables 


N 


Mean Square 


Probability 



Influences 



Classroom Practices 


1745 


3.21 


32.65 (.0001) 


Curriculum Design and Delivery 


1739 


2.34 


16.27 (.0001) 


Schoolwide Practices and Policies 


1744 


5.16 


47.30 (.0001) 


Federal, State, & District Policies 


1747 


3.72 


27.23 (.0001) 


Total 


1749 


3.65 


46.08 (.0001) 


Assessabilitv 


Classroom Practices 


1738 


.75 


5.55 (.0001) 


Curriculum Design and Delivery 


1728 


.31 


1.77 (.089) 


Schoolwide Practices and Policies 


1737 


.75 


5.77 (.0001) 


Federal, State, & District Policies 


1740 


3.04 


18.36 (.0001) 


Total 


1744 


.29 


3.15 (.003) 
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Average Influence and Assessability Ratings of Classroom Practice Items 
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Average Influence and Assessability Ratings of Classroom Practice Items (Coni'd) 
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Table 5 

Average Influence and Assessability Ratings of Classroom Practice Items (Cont d) 
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Schoolwide activities to increase student occupational aspirations 

Note: Items that have influence averages equal to or above 232 are designated with an I. 

Items that are assessability averages equal to or above 234 are designated with an A. 



Average Influence and Assessability Ratings of Schoolwide Practices (Cont'd) 
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Average Influence and Assessability Ratings of Curriculum Design and Delivery Items 
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Average Influence and Assessability Ratings of Federal, State, and District Policy Items 
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Table 9 



Fourfold Classification of Survey Items by Level of Influence 
(high vs. low) and Assessability (high vs. low) 



Low Influence, High Assessability 
Classroom Practices: 

Computer-assisted instruction. 

Academic tracking for specific school subject areas. 



Schoolwide Practices: no items 



Curriculum Design and Delivery: 

Availability of classroom aides. 

Federal, State, District Policies: 

Increased length of school year. 

Teacher licensure requirements. 

Increased length of school day. 

Small school size district. 

Minimum competency testing requirements. 

Low Influence, Low Assessability 
Classroom Practices: 

Teachers use of formal language during instruction. 

Prcscripti ve instruction combined with aspects of informal or open 
education. 

Discouragement of cliques (e.g., students work with many dif- 
ferent classmates). 

Encouragement of competition among students. 

Schoolwide Practices: 

School policy that promotes parent involvement in planning the 
instructional program (e.g., parents review materials, help plan 
curriculum.) 

Schoolwide promotion of increased out-of-school time spent by 
students in informal learning experiences (e.g., museum trips, 
scouts). 

School wide activities to encourage friendships rather than cliques. 

School wide discouragement of students spending out-of-school 
time viewing noneducational television. 

School wide promotion of increased out-of-school time spent by 
students viewing educational television 
Curriculum Design and Delivery: 

Teacher development of student self-responsibility for studying 
and for planning activities. 

Federal, State, District Policies: none 



Classroom Practices: 

Well-organized and well-planned class activities. 

Teacher provision of frequent feedback on student performance. 
Clearly defined teacher expectation of content mastery. 

Presence of a variety of classroom instructional activities and con- 
tent. 

Teachers use of corrective feedback when students make an error 
Smaller instructional groups 

Schoolwide Practices: 

Safe, orderly school climate 

School wide promotion of increased direct instruction time 
Low staff absenteeism 

Curriculum Design and Delivery: 

Use of materials tailored to students with different abilities 
Availability of materials and activities for use with whole 
classrooms, small groups, or one on one instruction 

Federal, State, District Policies: no items 



High Influence, Low Assessability 

Classroom Practices: 

Teacher "with-it-ness” (awareness of classroom events and ac- 
tivities and minimization of disruptions of timely and non-con- 
frontational actions). 



Schoolwide Practices: 

Teacher and administrator consensus on school values, norms, and 
roles 

Low staff alienation 



Curriculum Design and Delivery: none 
Federal, State, District Policies: none 
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Figure 2. Average Assessibility Ratings for each 
Professional Group by Category 



The Laboratory for Student Success 



The Laboratory for Student Success (LSS) is one of ten regional educational laboratories in the nation funded 
by the U.S. Department of Education to revitalize and reform educational practice in the service of children and youth. 

The mission of the Laboratory for Student Success is to strengthen the capacity of the mid-Atlantic region to enact 
and sustain lasting systemic educational reform through collaborative programs of applied research and development and 
services to the field. In particular, the LSS facilitates the transformation of research-based knowledge into useful tools that 
can be readily integrated into the educational reform process both regionally and nationally. To ensure a high degree of 
effectiveness, the work of the LSS is continuously refined based on feedback from the field on what is working and what is 
needed in improving educational practice. 

The ultimate goal of the LSS is the formation of a connected system of schools, parents, community agencies, 
professional organizations, and institutions of higher education that serves the needs of all students and is linked with a high- 
tech national system for information exchange. In particular, the aim is to bring researchers and research -based knowledge 
into synergistic coordination with other efforts for educational improvement led by field-based professionals. 
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For more information, contact Cynthia Smith, Director of Information Services, at (215) 204-3004 or csmith6@vm.temple.edu. 
To contact the LSS: Phone: (800) 892-5550 

E-mail: lss@vm.temple.edu 

Web: http://www.temple.edu/departments/LSS 
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